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ACCESS TO INTERNET DATA THROUGH A TELEVISION SYSTEM 

CROSS REFERENCE TO RELATED APPLICATIONS 

This application is a continuation of U.S. Patent Application 
5 No. 09/269,235, filed March 22, 1999, which claims priority of PCT 
Patent Application No. PCT/US97/18664 , filed October 16, 1997 
which, in turn is based on Provisional U.S. Patent Application Nos. 
60/028,138, filed October 16, 1996; 60/032,571, filed December 4, 
1996; 60/032,136, filed December 9, 1996; 60/035,236, filed January 
10 1, 1997; 60/035,029, filed January 8, 1997; 60/040,763, filed March 
14, 1997, the subject matter of each of these applications is fully 
incorporated herein. 

BACKGROUND 

15 The invention relates to interactive television systems 

capable of two-way communication with networked computer systems 
operating as information service providers, in particular Internet 
service providers. 

The Internet may be viewed as a large group of networked 

2 0 computer systems, each of which has a distinct alphanumeric 

address. A user terminal which seeks to receive data from one of 
the networked computer systems will send a command to the desired 
Internet address through the network to that system requesting that 
a particular set of data be sent to the terminal. The user 
25 terminals are connected to the network through the established 
telephone system in the user's community. An Internet address may 
be limited to the identity of the particular networked computer 
system, or may include additional information which directs the 
networked computer system to send a particular set of Internet 

3 0 data. The additional information may include a subdirectory, a 

file name, or both, which instructs the networked computer system 
which portion of data is desired by the requesting terminal. The 
system will thereafter send the requested data through the network 
to the terminal . Further exchanges of data may or may not take 
35 place between the terminal and the networked computer system, 
depending upon the desires of the terminal user. 
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The World Wide Web (WWW/ Internet) is an Internet network 
designed for popular use. Apparatus sold under the trademark 
"WebTV, " provided by Philips-Magnavox and Sony, allow television 
viewers to access the World Wide Web through their televisions. 
5 It is therefore desirable to enhance television viewing and 

Internet browsing by providing a more intimate interface between 
the viewer's television and the Internet access apparatus so that 
both television viewing and Internet browsing may be performed 
simultaneously, and preferably interactively such that the Internet 
10 data relates to the television program being viewed. 

SUMMARY OF THE INVENTION 

According to one embodiment of the invention, an interactive 
entertainment network system is provided which includes a number of 

15 user interface units in individual homes, each having a tuner, a 
display device and a modem or other data interface device for 
communicating with a data service provider. A television signal 
provider supplies a plurality of television signals to the tuner of 
each user interface unit, wherein at least one of the television 

20 signals has embedded data including a particular data address site. 
Information representing the particular data address site is 
displayed simultaneously with the television program on the display 
device, e.g., either as a graphical icon or text. A data service 
provider in two-way connection with the modem of each user 

25 interface site retrieves and transmits data corresponding to a data 
address site requested by an individual user interface unit for 
display on the display device of that user. 

According to another embodiment of the invention, a display 
controller for coupling to a display device and to a data retrieval 

30 terminal in two-way communication with a data service provider is 
provided. The display controller includes a tuner for receiving a 
television signal containing a television program and at least one 
embedded data unit including a data address site, means for 
extracting the at least one embedded data unit from the television 

35 signal, a memory for storing the at least one data unit, and a 
video display generator. The display controller also includes a 
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microcontroller coupled to the tuner and the extracting means and 
the memory for storing the at least one data unit in the memory, 
controlling the video display generator to display the data site 
address on the display device simultaneously with the television 
5 program, selectively retrieving the data site address from the 
memory in response to a user request, controlling the data 
retrieval terminal to request data corresponding to the user 
selected data address site from the data service provider, and 
controlling the video display generator to format and display the 
10 requested data received from the data service provider on the 
display device. 

According to yet another embodiment of the invention, a method 
is provided for enhancing viewing of a television program with 
interactive information retrieval. The method includes the steps 

15 of, at a television signal provider, embedding at least one data 
unit comprising a data site address into a television signal 
containing a television program. Then, at a user site, receiving 
the television signal, extracting the data unit from the 
television signal, displaying information representative of the 

20 data address site simultaneously with the television program on a 
display device, and then storing the data address site in a memory. 

Once the user selects the information representative of the data 
address site, a connection is established with a data service 
provider having access to data corresponding to the selected data 

25 address site, the data corresponding to the data address site is 
requested and transmitted from the data service provider to the 
user site. The retrieved data is then formatted and displayed on 
the display device at the user site. Preferably, several data 
address sites are stored in the memory simultaneously and, at the 

30 user's request, displayed in a menu from which the user can select 
a particular address site. 

BRIEF DESCRIPTION OF THE DRAWINGS 

The attached figures demonstrate alternative embodiments of a 
35 system designed in accordance with the present invention in which 



3 



31443/RRT/G207 

FIG. 1 is a block diagram schematic demonstrating a system 
according to one embodiment of the present invention; 

FIG. 2 is a display including an exemplary graphical icon 
identifying that a data address site is available with the 
5 displayed television program; 

FIG. 3 is a display of an Internet mode according to another 
embodiment which includes several data address sites; 

FIG. 4 is a display of the Internet mode according to the 
embodiment of FIG. 3 displaying' data corresponding to a selected 
10 data address site; 

FIG. 5 is a plan view of a remote controller for use with an 
embodiment of the invention; 

FIG. 6 is a display of the Internet mode according to yet 
another embodiment displaying data corresponding to a selected data 
15 address site; 

FIG. 7 is a block diagram schematic demonstrating a system 
according to a further embodiment of the present invention; 

FIG. 8 is a table including exemplary icons representative of 
various types of data address sites; and 
20 FIG. 9 is a block diagram schematic demonstrating a system 

according to yet another embodiment of the present invention. 

DETAILED DESCRIPTION 

According to a preferred embodiment of the invention, 
2 5 television programs are linked to data and/or graphics at Internet 
sites to expand the on screen information available to a television 
viewer . 

FIGS. 1-4 illustrate a specific embodiment of the invention. 
In FIG. 1, the reference numerals refer to the same elements 
30 described in application Serial No. 08/475,395 filed on June 6, 
1995, the disclosure of which is incorporated fully herein by 
reference . 

With reference to FIG. 1, a source of television signals 10 
such as a terrestrial antenna, or a cable is connected to a 
35 television tuner 11. The output of tuner 11 is a modulated 
intermediate frequency signal containing video and audio television 
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information. Tuner 11 is connected by an intermediate frequency 
amplifier (IF AMP) 12 to a picture detector (PICTURE DET) 13 and a 
sound detector (SOUND DET) 14, which produce base band video and 
audio signals, respectively. The audio signal is coupled by a 
5 sound amplifier (SOUND AMP) 15 to a loudspeaker 16. The video 
signal is coupled by a video amplifier not shown to one input of a 
switch 18. Sound detector 14 and picture detector 13 are connected 
to the audio and video inputs, respectively, of a video cassette 
recorder (VCR) 17. (Alternatively, television signal source 10 

10 could be directly connected to the RF input of VCR 17, if its 
internal tuner and demodulating circuitry is to be utilized.) The 
output of VCR 17 is connected to the other input of switch 18. The 
output of switch 18 is connected to one input of a conventional 
picture-in-picture (PIP) integrated circuit chip 19. The output of 

15 PIP chip 19 is connected to the video input of a television 
receiver or monitor (TV) 20 having a screen (not shown) . 

Internet data, including Internet site addresses, is stored in 
Internet data memory 36. Internet data memory 36 is connected to a 
microprocessor 24 that is programmed to control the operation of 

2 0 the described equipment (Internet data memory 36 could be part of 
the RAM of microprocessor 24) . An operating program for 

microprocessor 24 is stored in a read only memory (ROM) 26. A 
viewer input device 28, preferably in the form of a remote IR 
controller, is coupled to microprocessor 24 to provide commands 

2 5 from the viewer. A video processor 3 0 is coupled to microprocessor 
24. When the viewer wishes to see Internet site addresses, 
microprocessor 24 recalls a portion of the Internet data from 
memory 3 6 and couples it to video processor 30, where the Internet 
site addresses are formatted for display. Preferably, the 

30 information stored in video processor 30 is a bit map of what is 
displayed on the screen of television receiver 20. Video processor 
30 is connected to the other input of PIP chip 19. Preferably, 
viewer input device 2 8 controls microprocessor 2 4 by cursor 
movement on the screen of television receiver 20. To this end, 

35 microprocessor 24 and video processor 30 are coupled to a cursor 
position register 32. (Alternatively, the viewer can select items 
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of information displayed on the screen by keying into viewer input 
device 28 code numbers assigned to these items.) Microprocessor 24 
is also coupled to tuner 11 for channel change, to VCR 17 for 
play/record selection and start/stop, to switch 18 for selection of 
5 one of its inputs, and to PIP chip 19 for selection of the mode of 
PIP operation. 

According to one embodiment, an Internet service provider 
(ISP) 33 is connected to microprocessor 24 by a transmission link 
34 such as a telephone network or a television cable. An 

10 interface device such as a telephone or cable modem 38, or digital 
interface device (not shown) for a fiber optic connection, couples 
transmission link 34 to microprocessor 24 if necessary. ISP 33 is 
connected to an Internet backbone in well known fashion to access 
data at any site on the World Wide Web, or preferably the Internet 

15 generally. 

To enable a television viewer to access data about a 
television program that the viewer is watching, Internet data is 
embedded in the vertical blanking interval (VBI) of the television 
signal carrying the program. According to one embodiment, the 

20 Internet data includes the names and Internet addresses of a 
plurality of Internet sites. When the television signal carrying 
the program being watched is captured by tuner 11, the Internet 
data embedded in its VBI is stripped out by a VBI decoder 35 
coupled to microprocessor 24. Microprocessor 24 then stores the 

25 data in Internet data memory 36. The memory addresses of the 
Internet names are linked to the Internet addresses in memory 36. 

As shown in FIG. 2, a graphical icon 95 appears on the screen 
of television 20 when the television program is displayed full 
screen, i.e., in a television mode, to inform the viewer that 

30 Internet data accompanies the television signal and is stored in 
memory 36. Icon 95 can appear for a limited time period after the 
television program is first displayed or for the entire time period 
of the program. If the viewer wishes to access an Internet site in 
connection with the television program, the viewer presses mode 

35 button 56 on a remote controller 50, shown in FIG. 5, which 
introduces an Internet mode of operation described below. 
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Microprocessor 24 is programmed to carry out this operation. By 
repeatedly pressing mode button 56, the viewer can toggle back and 
forth between the television mode and the Internet mode. 

In one embodiment, the Internet site information is placed in 
5 a picture-in-picture ("PIP") window on the television screen such 
that the Internet site information may be viewed simultaneously 
with the television program. Conversely, the television signal may 
be placed in a PIP window on the television screen as shown in 
FIGS . 3 and 4. In this embodiment, the Internet site information 
10 occupies the majority of the television screen, and the television 
program . is displayed in a PIP window. In this manner, the 
television video signal may be viewed simultaneously with the 
Internet information, and thus supplement the information provided 
to the viewer. 

15 As shown in FIG. 3, the video portion of the television 

program last viewed in the television mode is displayed in area 42 
and the audio portion is reproduced by the speaker system of the 
television set. As an option, a textual description of the program 
is displayed in an area 44 and information about the television 

20 program, i.e., program title, station name, and channel number are 
displayed in a banner 49 underneath areas 42 and 44. A message is 
displayed at the top of an area 46 to prompt the viewer to select 
from a number of Internet site names displayed in area 46 by moving 
a cursor 48 with arrow keys 58 and 60 (see FIG. 5) . For example, 

25 the Internet site names may be related to the particular program 
("1. 'MARRIED WITH CHILDREN' TRIVIA"), the particular broadcaster 
("2. TONIGHT ON FOX (SCHEDULE)"), general services offered by the 
system provider ("3. SPORTS"; "4. SHOPPING"), or directed to the 
particular user's Internet account ("5. E-MAIL"). 

30 After an Internet site name is selected, the viewer presses 

INFO button 54 on controller 50. As a result, the Internet site 
address to which the selected Internet site name is linked is 
retrieved from memory 36 by microprocessor 24 and sent through the 
telephone or cable interface to ISP 33. Once the microprocessor 24 

35 has been directed to initiate data acquisition, it will instruct 
the modem 25 to connect to an Internet service provider (ISP) . 
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After establishing a connection to the ISP, the microprocessor 24 
initiates a data request from the Internet site address which was 
received along with the graphical icon transmitted in the data 
unit. The microprocessor 24 thereafter receives the requested 
5 Internet data, and stores it in RAM. The requested Internet data 
may include graphics, text, or a combination of both. After 
receiving the Internet data, the microprocessor may or may not 
terminate the modem connection to the ISP, depending upon the 
design of the embodiment, or the configuration options set by the 

10 viewer. (If desired, this function of microprocessor 24 could be 
carried out by commercial equipment sold under the trademark 
"WebTV," provided by Philips/Magnavox and Sony.) 

The information at the addressed Internet site is downloaded 
from ISP 33 over transmission link 34 to microprocessor 24 and then 

15 displayed on the screen simultaneously with the television program 
to which the information relates, as illustrated in FIG. 4, after 
being composed by video processor 30. As illustrated in FIG. 4, 
the name of the Internet site can be displayed above the text of 
the information from the Internet site. If the television program 

20 is a television series such as "Married With Children, " the 
displayed information could be an Internet "page" trivia about the 
show (FIG. 4) , merchandising and home shopping information, or a 
link to a fan e-mail site. The viewer then navigates about the 
Internet site in the manner dictated by the viewer's software to 

25 find the desired information. 

Only an initial portion of the Internet data is displayed, as 
the amount of Internet data received will likely exceed the amount 
conveniently displayable at one time. The viewer may "scroll" 
through the remainder of the Internet data or "page," at his or her 

30 discretion, in one embodiment by utilizing arrow keys on a remote 
control. The user interface of the page viewing may be 
accomplished in a conventional manner, e.g., in the manner of a 
typical PC-based web browser, or the user interface associated with 
WebTV, provided by Philips-Magnavox, or Sony. 

35 If desired, the display of FIG. 3 could be eliminated. In 

other words, only one Internet site address would be embedded in 
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the VBI of the television signal and the viewer would not make an 
Internet site selection. In this case, inclusion of the Internet 
site name is optional, because the viewer does not have a choice of 
Internet sites. When the viewer wishes to access Internet 
5 information about a program marked with an icon, the viewer presses 
button 56, the VBI Internet site address is sent through the 
telephone or cable interface to ISP 33, and the display of FIG. 4 
appears directly on the screen with the VBI Internet site name. 
Preferably, the television program is displayed full screen until 

10 the data retrieved from the ISP 33 is available for display, i.e., 
after establishing a connection with the ISP 33, requesting the 
data, etc. Preferably, the graphical icon 95 ceases to be 
displayed once the viewer selects the Internet data. 

In a typical Internet "web page," there are "links" to other 

15 Internet addresses, which provide alternative or complementary data 
to that found in the originally displayed web page. In a preferred 
embodiment of the invention, a user may select one of these links 
with a remote control, utilizing arrow keys 58, and/or on-screen 
cursor 48. For example, in FIG. 4, the answer to the trivia 

20 question is contained in a linked web page the viewer can select to 
confirm his or her response. These links are commonly referred to 
as "hypertext" links. If a link is selected, the microprocessor 
transmits the desired address to the ISP, and thereafter receives 
and displays the newly-received Internet data in the manner 

25 described above. Thus, if it is desirable to allow the viewer to 
link to additional Internet site addresses, the microprocessor 
should maintain the modem connection to the ISP 3 3 until directed 
by the user to terminate the connection. In this manner, the 
repeated request and receipt of successive pages will not 

30 necessitate delays associated with initiating a connection to the 
ISP 33. 

In order to accommodate the simultaneous viewing of both the 
Internet site Internet information and the television signal, 
particularized display formats may be used. In a further 
35 embodiment, the information for the Internet site is formatted to 
fit around the PIP window in which the television program is 
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displayed, as shown in FIG. 6. Typical Internet data received over 
the World Wide Web is transmitted in HyperText Markup Language 
("HTML") . A typical HTML file includes text, graphics, and 
instructions for formatting the text and graphics on a screen, 
5 along with other embedded commands. A computer or other terminal 
displaying an HTML file will format the file for display on the 
screen, based in part upon the embedded instructions for formatting 
the text and graphics, and based in part upon the requirements for 
aesthetic* and efficient display of the information on the 

10 particular viewing device. 

When displaying two video signals simultaneously using the PIP 
format, typically one video signal occupies the majority of the 
viewing screen, while the second video signal is displayed in or 
near to one corner of the television screen and typically occupies 

15 one quarter of the screen or less. With this type of display 
format, the second video signal obscures a not insubstantial 
portion of the first video signal. This can result in an 
inefficient and undesirable display of information to the viewer 
when PIP is used in connection with the present invention. 

20 Hence one aspect of the present invention includes a 

microprocessor adapted to format the HTML file received over the 
Internet in such a manner as to accommodate the television program 
signal in one portion of the television screen. In this manner, 
the television program signal may be viewed simultaneously with the 

25 Internet HTML information, without obscuring any of the Internet 
HTML information by the television program signal. For example, if 
it is desired to place the television program signal in a PIP 
window in the top right hand corner of the television screen, the 
HTML file should be reformatted by the WebTV terminal (or other 

30 Internet display device associated with the system) to display 
information only in the remainder of the screen, such that it will 
not be obscured by the overlaid television program signal. In this 
instance., the HTML file would be reformatted into the "L" shaped 
display 69 of FIG. 6, so that the right hand corner of the Internet 

35 video signal contains no information to be obscured by the 
television program signal. 
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It should be noted that the user interface of this embodiment 
is designed so the television remote controller 50 can also be used 
to navigate the website, in addition to operating the television 
and guide functions. 
5 According to another embodiment of the invention, shown in 

FIG. 7 , a conventional television 70 is provided with a Vertical 
Blanking Interval (VBI) decoder 72 and a separate Internet access 
type terminal 7 4 connected to the Internet, for example apparatus 
sold under the trademark "WebTV". A microprocessor 76 that 

10 controls the operation of the television 70 is programmed to 
perform the functions described below. 

The Internet access terminal 74 includes a microprocessor 78, 
a Random Access Memory 80 (RAM), a modem 82, a user input device 
such as a remote control 50 or a keyboard 86, and a video signal 

15 generator 88. In typical operation, the microprocessor 78 of the 
Internet access terminal 74 will receive user input regarding 
particular data to be received over the Internet; utilizing the 
modem 82, the microprocessor will receive the desired data 
(typically a "web page" consisting of formatted text and/or graphic 

20 images) and output a video signal suitable for displaying the 
desired data on the screen of an attached television monitor. 

Television 70 has a tuner 89 and RAM 90 coupled to Internet 
access terminal 74. The Internet access terminal 74 sends a video 
signal to the television set. The microprocessor 7 6 is provided 

2 5 with an infrared transmitter 92 to send commands to the Internet 
access terminal 74. Additionally, keyboard 86 or remote controller 
50 is configured to send infrared commands to either the Internet 
access terminal 74 via IR receiver 101 or to the television 70 via 
IR receiver 93 . 

30 The Internet access terminal 74 is coupled via a standard 

telephone line to ISP 33, which functions in the displayed 
embodiment as an ISP. The server is configured to send and receive 
data over the World Wide Web (WWW/Internet) to and from computer 
systems networked thereto. 

35 In a preferred embodiment of the present invention 

corresponding to the system shown in FIG. 7, data representative of 

11 



31443/RRT/G207 

on-screen graphical icon, along with an associated Internet site 
address, is transmitted as a single data unit, packet, or group of 
packets in the VBI of a television signal. The VBI has been 
demonstrated over the past two decades to be a suitable vehicle for 
5 the transmission of digital data along with a television signal. 
In particular, the VBI is well-adapted for the transmission of 
relatively small packets of data. The graphical icon 95 is 
displayed on-screen with the associated television signal as 
described above in reference to FIG. 2. 

10 A television signal incorporating the above mentioned data 

unit is sent by a television station 96, and is carried by a cable 
provider. In alternative embodiments, the television signal may be 
sent by conventional broadcast, or by satellite. When the 
television signal is carried by cable, the user's home is typically 

15 equipped with a cable decoder 98, which extracts the tuned video 
signal, which is the television signal combined with the data unit 
in the VBI. The cable decoder 98 is capable of being controlled by 
the microprocessor by infrared transmitter (not shown in the 
drawings) . The video signal is thereafter delivered to a VCR 100, 

20 which also is capable of being controlled by the microprocessor by 
infrared transmitter (not shown in the drawings) . Both the video 
signal and the data in the VBI of the video signal are delivered to 
the television 70. VBI decoder 72 for separating the data in the 
VBI from the video signal, and for delivering that data to the 

25 microprocessor . 

Data units may be transmitted in the VBI of all channels 
serving a particular broadcast region, or they may be included by 
program creators (producers, advertisers, etc) in the VBI of the 
videotape provided to a broadcaster. In this manner, when the 

30 program is replayed for broadcast by a broadcaster, the data unit 
containing the Internet site address and other information is 
present in the broadcast and may be received by any apparatus 
viewing the program. 

The information at the Internet site corresponding to the 

35 transmitted Internet site address is preferably related to the 
content of the program currently being telecast in the television 
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signal, which contains the data unit transmitted in the VBI . 
Preferably, a descriptive title for the Internet site address that 
will enable the viewer to distinguish the Internet site from other 
Internet sites is also included in the data unit. When the data 
5 unit transmitted in the VBI is received at a television receiver 
with the program, it is stored in a temporary buffer portion 102 of 
the RAM 90. Preferably, the storage capacity of the temporary 
buffer is one data unit, so that each new data unit overwrites and 
replaces the previously received data unit. Alternatively, each 

10 successively received data unit is placed on the top of a stack in 
RAM, so that previously received data units will still be 
accessible to the microprocessor if desired by the viewer. 

The extracted data includes data representative of an on- 
screen graphical icon and an Internet site address, as referred to 

15 above in reference to FIG. 2. The microprocessor superimposes the 
graphical icon 95 on a portion of the displayed video signal, thus 
indicating to the user that additional information concerning the 
television program is available through the Internet. The 
graphical icon will preferably be placed in an unobtrusive portion 

20 of the television signal, e.g. such that it is displayed on a 
corner of the television monitor as shown in FIG. 2. 

The viewer is thereby alerted to the presence of additional 
information concerning the displayed television program. At the 
viewer's initiation, the microprocessor may begin the process of 

25 acquiring the desired additional information over the Internet. 
The viewer initiates the process of data acquisition by pressing 
SELECT button 58 on remote controller 50 (see FIG. 5) or other 
viewer input device. Alternatively, the viewer initiates the 
process by pointing a cursor 108, with a mouse or other pointing 

30 device (not shown) , to the location of the on-screen icon 95, as 
shown on the exemplary full screen display of FIG. 2. 
Alternatively, the viewer may direct the microprocessor to store 
the Internet site address and descriptive title in the manner 
referred to above for later use responsive to an on-screen 

35 selection process. 
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The graphical icon 95 is overlaid on the screen as soon as it 
is received and is thus displayed simultaneously with the program. 

If the viewer wishes to receive more information about the 
displayed program, e.g., more details about a commercial, 
5 additional details concerning a news story, or statistics about a 
sporting event, the viewer presses a STORE button 55 on remote 
controller 50 (see FIG. 5) to transfer the Internet site address 
and the corresponding descriptive title, e.g., "Today's NFL Game 
Scores" to a directory portion of the RAM and to extinguish the 
10 icon on the screen. Any number of Internet site addresses can be 
stored in the directory in this manner as the television viewing 
session progresses. 

Alternatively, the viewer may press a button 54 on the remote 
control, designated by "INFO," or some other informative 
15 designation, to access a menu of options. One option is to store 
the Internet site address and associated descriptive title. 
Another option may be to immediately access the Internet and obtain 
the additional information. Other options consistent with the 
disclosure of the present invention may be present on the menu 

2 0 presented to the viewer. 

According to yet another embodiment corresponding to the 
system shown in FIG. 7, the directory is managed as a web browser 
bookmark memory. The website addresses and titles are stored in 
the directory until they are deleted or replaced by new addresses 

25 and titles on a first-in- first-out basis when the directory is 
full. Alternatively, the newly received website addresses replace 
old addresses and titles on a next- in, least-used basis, i.e., when 
a new website address and title is received, it is stored in memory 
in place of either the most infrequently accessed website 

30 address/ title in the bookmark memory, or in place of the least- 
recently accessed website address/ title . Preferably, the 

microprocessor is programmed to permit the individual user to 
select which mode of memory management to utilize. 

When the viewer wishes to establish a connection to the 

3 5 Internet site of one of the stored addresses, the viewer presses a 

MENU button 57 to display the Internet site titles, and optionally 
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the corresponding Internet site addresses, stored in the directory. 

The viewer selects the desired title with on screen cursor 108 and 
then presses a SELECT button 58. As a result, the microprocessor 
transfers the corresponding Internet site address to the Internet 
5 access terminal 74, the Internet site is connected to the Internet 
access terminal 74 and information from the Internet site is 
displayed on the screen instead of the television program. 

In yet another embodiment corresponding to the system shown in 
FIG. 7 , the present invention is incorporated into a cable decoder 

10 98. In a standard cable decoder, there are present a 
microprocessor 118, an on-screen display facility 120, a VBI 
decoder 122 (in addressable decoders), and a tuner 124. Thus, the 
present invention may be implemented in a cable decoder environment 
with the addition of a modem 126 for data connection to an ISP, and 

15 sufficient RAM for the receipt and display of the Internet "web 
page." As bidirectional transmission by cable becomes available, 
the telephone modem 12 6 can be eliminated and the cable system, in 
conjunction with suitable hardware, can be used to connect the user 
terminal to the Internet or other data provider. 

20 In a further embodiment, rather than receiving the desired 

additional information over the Internet, a dedicated computer 
system 128 could be utilized. In a system of this nature, the 
dedicated system would serve as a clearinghouse or dedicated 
database for the storage of the related information. When a 

25 broadcaster desired to provide additional information, it transfers 
the additional information and a unique identifying code to the 
centralized database utilizing conventional techniques. 
Additionally, the information may be transmitted to the centralized 
database on a television or cable signal. Finally, the additional 

3 0 information may be supplied to the user in the form of a CD-ROM or 
other large scale portable memory device. Thereafter, when a user 
desired additional information, the microprocessor would initiate a 
connection to the dedicated system to receive and display the 
additional information in the manner described above. Such a 

35 dedicated system could be integrated with the Internet so that some 
information could be supplied to the user by Internet and some 
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information could be supplied by the dedicated system. The 
dedicated system could be the user's own personal computer system 
so that the data site addresses received over the VBI correspond to 
data previously stored, by one of the above-described methods, in 
5 the user's personal computer, e.g., in a CD-ROM or transferred by 
modem. 

In another embodiment of the present invention, Internet data 
at an Internet site may also be linked to particular television 
programs to expand the information available to an Internet 

10 browser. Specifically, Internet text or graphics at an Internet 
site is marked with an icon or designated as hypertext to represent 
that a related television program is scheduled for telecast. If 
desired, different icons could be used to distinguish between 
currently telecast programs and programs to be telecast in the 

15 future. The icons are linked to data at the Internet site 
representing channel, day, time, and length (i.e., CDTL) or the 
related television programs. This aspect of the invention is 
particularly convenient for a television aficionado who is reading 
Television Guide-like articles on line to click on hypertext in the 

2 0 article to set up a television program for viewing or recording. 
If the Internet user wishes to watch or record a television 
program, the user clicks on the icon with a mouse, e.g., one click 
to watch and two clicks to record, and the CDTL data is transmitted 
by the Internet connection to the WebTV terminal at the user's 

2 5 location. The WebTV terminal couples the CDTL data to the 

microprocessor. If the CDTL data identifies a currently telecast 
program, the microprocessor operates the television receiver or the 
VCR, depending upon whether one click or two clicks were entered, 
and sets the appropriate tuner to the designated channel. If the 

3 0 CDTL data identifies a future program, the microprocessor stores 

the CDTL data in the recording/play stack for use in recording or 
play at the designated time. 

The embodiment depicted in FIG. 7 is therefore capable of 
performing the functions described above in accordance with the 
35 present invention. In addition, the ISP is capable of providing 
data to be incorporated into the VBI of the transmitted television 

16 
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signal which notifies a particular user that he or she has received 
■ electronic mail. Thus, when viewing television, the viewer may be 
informed by an on-screen icon 130 that he or she has received 
electronic mail, and the viewer may thereafter direct the 
5 microprocessor to control the Internet access terminal 74 to obtain 
and display the electronic mail message or messages. When this 
function is implemented, the VBI includes an identification code or 
address that uniquely designates a particular viewer's apparatus, so 
that only the designated apparatus at the site where the electronic 

10 mail message is received actually displays the electronic mail 
icon. The electronic mail data units with identification codes are 
routed to the respective broadcast regions where the recipients are 
located. The data to be broadcast to a particular region may be 
provided to a network affiliate in that region to be inserted into 

15 the VBI before broadcast. 

The data unit transmitted to a particular user to inform him 
or her that he has received electronic mail may also include the 
subject or sender of the mail message. In this manner, the viewer 
may view the subject or sender of the mail message on the 

20 television screen without connecting to an ISP to receive the 
entire mail message. The viewer may therefore "screen" his or her 
E-mail, and connect only when the mail message is of interest or 
importance to him or her. Data units indicating the presence of 
electronic mail, or other uniquely addressed data units may be 

25 transmitted on all channels of a particular broadcast region, or 
may be provided on a single channel to which the tuner tunes when 
the television is not in use. When not in use, the microprocessor 
may therefore monitor the VBI of this single channel and obtain any 
directly addressed data units. Alternatively, an apparatus may be 

30 equipped with two tuners, one of which is constantly tuned to the 
channel containing the VBI data, and one of which is used to tune 
to television signals for display. 

As shown in FIG. 8 potential on-screen icons include an icon 
132 representative of the availability of additional information in 

35 a video program. For example, an extended advertisement, or how-to 
show, or local information program may be available at another time 



31443/RRT/G207 



or on another channel. By pressing an appropriate button on the 
remote control, the microprocessor may be directed to record that 
show. Data in the data unit representative of CDTL may be placed 
into a location in the RAM, such that the VCR is set to record the 
5 program at the time of its airing. In addition, a data unit may be 
transmitted and directed to a particular user's apparatus which 
carries a command to the microprocessor to record a television 
program at a particular channel, date, time, and length. If a user 
is not present to program his or her VCR for recording, he or she 

10 may direct that a data unit be sent to his or her apparatus with a 
command to record a particular program or programs . The command 
could be complex recording sequence configured for serially 
broadcast television programs such as a miniseries which airs at 
different times on different nights of the week. This can be 

15 particularly useful when a user has forgotten to program a future 
recording, but has left his or her home. The user may direct the 
transfer of such a data unit using electronic mail to an ISP, or by 
telephone link to a location which will direct the actual transfer 
of a data unit. 

20 Another potential on-screen icon is an icon representative of 

an Internet website address link 134. As described above in 
detail, the user may select this icon to obtain an Internet site 
address for locating and viewing additional information concerning 
a particular news show, sports event, or advertiser. 

25 A third potential on-screen icon is an icon representative of 

a VCRPlus+ link 136 which may be provided, for example, in 
connection with an advertisement for another television program. 
When a user presses the appropriate keys on his or her remote 
control, the microprocessor stores the CDTL of that program, which 

30 is transmitted in the data unit, and records or displays the 
program at its time of airing. 

A fourth potential on-screen icon is an icon representative of 
a Buy Link 13 8 which may be provided to send an order to the 
provider of goods or services via the incorporated modem 77, or via 

35 the WebTV terminal 74. The microprocessor will be guided by the 

18 
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data in the data unit as to the address or other location to send 
the viewer's order. 

As an alternative to the standard set of icons, which 
represent the type of option available to the user, the data unit 
5 may include a particular descriptive icon which will be displayed 
on the screen. For example, the transmitted icon could consist of 
a digitized version of a manufacturer's logo. 

If the particular embodiment is adapted for displaying 
standardized icons as set forth in FIG. 8, the digital data 

10 representative of the graphical icons could be stored in RAM or ROM 
at the viewer's location, with the data unit including a pointer to 
refer to the stored graphical icon. In this manner, the amount of 
data to be transmitted may be reduced. In addition, if specialized 
logos are desired to be used in addition to or in place of 

15 standardized icons, the digital data representative of these icons 
may be sent in bulk at a particular time (such as the late night 
when the television set is not likely to be used) . Afterwards, the 
data unit need only include a pointer to the graphical icon, rather 
than the full set of digital data representative of the particular 

20 icon. 

In yet another embodiment of the present invention, the 
microprocessor 24 incorporated into the television is equipped with 
an infrared transmitter suitable for transferring data to a 
portable device 140, as shown in FIG. 9. The system shown in FIG. 

25 9 is substantially similar to the system shown in FIG. 1, with 
identical components having the same reference numbers. The 
transmitter incorporated into microprocessor 24 may also be 
provided in the form of a direct wire link, radio frequency 
transmitter, or some other means for providing digital data to the 

3 0 portable device. The microprocessor is adapted to transmit the 
received Internet site address and/or the descriptive title thereof 
to the portable device for storage therein. The portable device 
must therefore be adapted to receive the transmission as well as to 
store the transmission in RAM or some other storage means. 

35 Once the Internet site address and/or descriptive title have 

been stored in the portable device, the user may thereafter 

19 
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transfer the stored Internet site address to a personal computer 
142 suitable for connection to the Internet. The portable device 
140 is therefore equipped with a transmitting apparatus, possibly 
infrared, radio frequency, or direct wire link for sending the 
5 digital data representative of the Internet site address to the 
personal computer. Once received by the personal computer via an 
interface 144, the user may connect to the Internet and obtain the 
additional information over the Internet. 

The portable device may take the form of a portable computer, 

10 such as a Pilot or Newton, or may take the form of a portable 
Internet terminal, which itself is operable to connect to the 
Internet through an ISP, possibly by wireless two-way 
communications such as a cellular telephone connection. 
Alternatively, the portable computer could be removed from the 

15 system and the microprocessor 24 could be linked in direct 
communication with the user's personal computer 142, e.g., by IR 
emission of information and command signals to PC interface 144. 

The described embodiments of the invention are only considered 
to be preferred and illustrative of the inventive concept; the 

20 scope of the invention is not to be restricted to such embodiment. 
Various and numerous other arrangements may be devised by one 
skilled in the art without departing from the spirit and scope of 
this invention. 



20 



